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ABSTRACT 


If,  in  applying  the  Decomposition  Principle  of  George  B.  Dantzlg  and 
Philip  Wolfe,  [1],  [2],  we  start  from  a  feasible  basic  solution,  say  x°  , 
we  obtain  at  the  end  of  the  first  iteration,  a  feasible  solution,  say  , 
which  generally  is  not  a  basic  one.  However,  one  can  easily  coanpute,  from 
and  ,  the  feasible  solution,  say  x  ,  which,  on  the  half -line 
x°  +  9  (x^  -  x°),  9^0  ,  is  the  farthest  from  x°.  The  question  then  arises 
to  find  an  expeditious  way  for  starting  the  next  iteration  with  x  (so  as 
to  have  Decomposition  Principle  altogether  with  feasible  basic  solutions). 

In  this  report,  we  tiy  some  possible  ways  along  that  line.  The  con¬ 
clusions  are: 

1.  The  best  of  the  algorithms  which  are  examined  is  that  of 
Section  4  and  5; 

2.  This  latter  algorithm  is  shown,  in  Section  6,  to  be  the  simplex 
algorithm  in  the  case  where  it  Is  kept,  in  the  memories  of  the 
computer,  some  special  kind  of  a  combijaation  of  the  original 
data  and  of  some  currently  computed  quantities; 

3.  Finally  it  is  shown  that  there  exists  very  little  differences 
between  this  algorithm  and  the  algorithm  of  G.  B.  Dantzig, 

A.  S.  mnne,  W.  Orchard-Hays,  and  J.  T.  Robacher  [3],  and  that 
it  is  possible  to  find  raany  other  algorithms  along  the  same 


line  of  ideas. 


ON  DECOMPOS.ITION  PRINCIPIE 


i-  Trit.-roduction  and  Notations 


We  consider  the  following  linear  program: 


Program  1  Minimize  cx 

subject  to  Ax  =  a 

(2)  ^ 

(3) 

We  assume  that  x  is  any  point  in  the  n-dimensional  real  vector  space  R 
(l.e.,  any  column  vector  with  n  real  elements)  that  A  is  a  p  x  n  matrix, 
that  B  is  a  X  n  matrix,  and  that  the  p  +  <1  equations  (l),  (2)  are  inde¬ 
pendent;  we  set  p  +  q  =  m  . 

We  shall  call  Q  the  polyhedron 

(2)  Bx  =  b 

(3)  X  ^  0 

and  M  the  polyhedron  defined  by  (1),  (2),  (3);  in  other  words,  Q  is  the 

section  of  M  by  the  linear  variety  Ax  =  a. 

We  shall  assume,  throughout  this  report,  that  there  is  no  degeneracy  of 
any  kind  (that  is,  we  disregard  any  difficulty  which  can  be  avoided  by  some 
e-perturbation  of  the  right-hand  sides  a  ,  b  or  some  e -perturbation  of 
the  cost-vector  c;  we  even  assume  that  these  perturbations,  if  necessary, 

have  been  made  previously). 

Let  X°  be  an  extreme  point  (a  vertex)  of  Q  ;  we  set 
j  =  J(X°)  =  ( j ;X°  >  0} 

Then,  by  the  non- degeneracy  assumption,  the  matrix  whose  columns  are 

fB*^)  (and  which  we  call  B'^)  is  a  square  nonsingular  matrix. 

'jeJ 


(6)  y";  ^  yr  (unrestricted) 

This  cone  C(X°)  Is  characterized  hy  the  following  property: 
if  y  €  C(X°)  ,  then  X°  +  Qy  e  C(X°)  for  some  strictly 
positive  scalar  0  .  We  shall  write  an  explicit  formula 
for  points  in  C(X°):  let  Q  he  expressed  with  X°  ;  then 
the  extreme  half -lines  of  C(X°)  are  generated  hy  the 
following  vectors  ,  where  j  is  any  index  in  J  (so 
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that  C(X°)  has  exactly  n  -  q  extreme  half-lines}:  the 
components  of  are 

(7)  =  1 

(8)  >  if  k  €  J 

(9)  ^  >  if  k  e  J+J 

(where  J+J  means  the  union  of  the  two  sets  J  ,  (j})  and  the 
bar  denotes  the  complementary  set.  From  (7)  and  (9) 
these  n-q  vectors  are  independent  (each  one  has  a  component 
equal  to  1,  while  this  same  component  is  zero  for  any  other)  . 
The  explicit  formula  for  points  in  C(X°)  is 


where  the  M-. 's  are  noxinegative  arbitrary  scalars. 

J 

2 .  One  Iteration  of  the  Decomposition  Principle,  Starting  from  an  Extreme 
Point  of  M. 

In  this  section,  we  assume  that  the  polyhedra  Q  and  M  are  both 
bounded.  The  general  case  could  easily  be  covered,  at  the  expense  of  some 
more  explanations. 

Let  x°  be  an  extreme  point  of  M;  then  by  the  non-degeneracy  ass\miption, 
x°  is  in  the  relative  interior  of  a  p-dimensional  simplex,  say  F^(x°)  ,  of  Q  , 
and  so  can  be  expressed  as  a  convex  combination  of  p+1  extreme  points,  say 
X°  ,  X^, ....,X^,  of  the  face  F^(x°)  (that  is  to  say:  p+1  extreme  points  of 
Q  which  belong  to  F^(x°);  they  form  a  p-dlmensioixal  simplex).  Let  this 
expression  be 


-5- 


(6)  ^  7v°  <  1  , 

i€L 

We  assume  that  Q  is  expressed  with  the  extreme  point  X°  ,  and  we 
consider  C(X°).  Among  its  extreme  half -lines,  some  may  be  in  F^(x  ),  and 
some  are  not.  We  set 


(7)  K  =  J(x°)  =  {J  :  x°  >  0} 

(8)  I  =  J(x°)  -  J(X°)  =  K-J  (the  relative  complement  of  J,  with 
respect  to  K).  Then  F^(x°)  is  defined  by 

(9)  Xj  +  x^  =  'B 

(10)  ^  ° 
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(11) 


(12) 


*k'  °  ’ 


where  the  vectors  ,  x^  are  defined  by 


e  ic 


and  where  is  the  suhmatrlx  of  E  where  colums  are 

the  extreme  half -lines  of  C(X°)  which  are  not  in  F^(x°)  are 


X  =  X°  +  0Y® 


where  the  scalar  0  is  ^  0  ,  and  the  index  s  e  K  (notice  that  K  is  not 

empty  if  we  assiime,  as  we  do,  that  x°  is  not  the  unique  solution  of  Ax  =  a, 

Bx  =  h  and  x  ^  O).  Since  Q  is  hounded,  there  is  a  maximum  value  of  0  such 

that  X>  0:  let  this  maximum  value  he  0  .  Then,  we  set 

»  s 


xP+1 


X  +  Y 


0 

s 


f 


and  we  notice  that  X^^^  is  an  extreme  point  of  Q  . 

We  consider  the  (p+l) -dimensional  simplex  whose  p+2  extreme  points 
are  X^X^,X^, . . .  one  of  its  p-dlmenslonal  simplexes  is  precisely  F^(x°). 

We  take  the  intersection  of  this  (p+l) -dimensional  simplex  with  the 
(n-p) -dimensional  linear  variety  Ax  =  a  .  This  intersection  exists  (x°  is 
one  point  of  this  intersection).  Moreover,  since  x°  belongs  to  the  relative 
interior  of  P^(x°),  this  intersection  is  a  segment  [x°,x^]  ,  where  x^  belongs 
to  the  relative  interior  of  one  of  the  p-dimensional  simplexes  of  the  (p+l)- 
dimensioml  simplex.  This  p-diraensional  slnrplex  containing  x^  is  distinct 
from  F^(x°).  Then  x^  can  be  expressed  as  a  convex  combination  of  p+l 
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must  “be 


o  1  2  P+1  .rP+1 

points  among  the  p+2  points  X,X,X,...,X  ;  moreover,  X 

taken  (with  strictly  positive  coefficient)  in  this  combination,  and  one  of 

the  p+1  points  X°,  X^,  X^, . . . ,X^  must  have  zero  coefficient. 

Case  1,  X°  has  a  zero  coefficient  in  the  convex  expression  of  x^:  we  then 
take  X^"*"^  (for  expressing  Q)  instead  of  X  Cchange  of  hasis 
in  the  sub  -problem" ) . 

Case  2,  X°  has  a  strictly  positive  coefficient  in  the  expression  of  x^: 

there  is  no  need  to  change  the  expression  of  Q  (no  change  of  basis 
in  the  sub-problem). 

The  two  cases  are  illustrated  by  the  figures  1  (for  Case  l)  and  2 
(for  Case  2),  where  p  =  1  and  the  pentahedra  represent  F^(x°). 


We  see  that,  in  Case  1, 
it  is  in  Case  2). 


1 


X 


is  no  more  an  extreme  point  of  M  (while 


-6- 


In  order  to  make  a  step  toward  the  solution  of  Program  1,  we  need 
cx^  <  cx°  .  Some  results  now  will  be  useful;  the  first  two  of  them  do  not 
need  any  proof 

The  hypothesis,  when  not  expressed,  are  those  above  in  the  present  and 
first  sections. 


LEMMA  1  -  The  set  of  vectors 


is  an  independent  set. 


0  Q 

LEMMA  2  -  (Corollary  of  Lemma  l).  The  matrix  whose  columns  are  A(X  -  X  )  i€L 
is  a  square  and  nonsingular  matrix. 

We  denote  by  a  the  square  matrix  which  is  the  inverse  of  the  matrix  in 
Lemma  2. 


TTfRQREM  1  -  The  hyperplane  containing  F^(x°)  and  parallel  to  Ax  =  0  and  to 
cx  =  0  has,  as  an  equation: 

(15)  (c  -  u^A)  X  =  (c  -  u^A)  X°  , 

where  u^  is  the  unique  solution  of 

(14)  (c  -  uA)  (X^  -  X°)  =  0  ,  VieL. 

PROOF  -  It  is  well  known  that  the  general  equation  of  a  hyperplane  parallel 
to  Ax  =  0  and  to  cx  =  0  is 

(vc  -  uA)x  =  w  , 

where  v  ,  w  are  scalars,  and  u  is  a  row-vector.  Moreover,  the  hyperplane 
(15)  contains  X  ,  and  contains  X  if  and  only  if  (l4)  is  true.  But,  by 
lemma  2,  (l4)  has  one  and  only  one  solution,  say  u^  .  The  hyperplane  (I5) 
contains  p+1  points  X°  ,  X^, ...,X^  of  the  p-dlmensional  face  F^(x°): 
it  then  entirely  contains  this  face.  Finally,  the  proof  shows  the  uniqueness 
of  the  hyperplane,  which  justifies  the  word  "the"  at  the  beginning  of 
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theorem  1. 


THEOREM  2  -  We  have 


1  ^  o 

cx  <  ex 


if  and  only  if 


(c  -  u  A)  c;;  (c  -  u  a)  X° 

o  ^  o 


PROOF  -  We  first  notice  that 


1  o 
cx  -  cx 


=  (c  -  u  A)x^  -  (c  -  u  A)x° 

'  r\  '  r^  '  ^ 


since  u  Ax^  and  u  Ax°  are  both  eqxial  to  u  a. 
o  o  o 


Moreover,  x^  belongs  to  the  (p+l) -dimensional  simplex  generated  by 
o  1  p+l 

^  ^  ^  *  *  *  f  A. 

In  Case  1,  x^  belongs  to  the  p-dimensional  simplex  generated  by 
X^  ,  X^, . . .  jX^"*"^  .  We  then  have  by  formula  (4): 


(18)  x°  =  X°  +y  (X"^  -  X°)  , 


and  by  a  similar  argument: 


where 


^1  ^  ^p+1  (x-^  -  , 


>  0  ,  V  ieL 


From  (it),  (18),  (19)  and  (l4),  we  have 
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cx^  -  cx°  =  (c  -  u^A)  -  X°)  + 

^  (c  -  u^A)(X^  -  X^'*’^)  -h^  . 

£eL 


Whence,  replacing 


X^"^^  by  X‘^ 


X°  +  X°  -  , 


cx^  -  cx°  =  (1  -  (c  -  u^A)  -  X°)  , 

i€L 

which,  due  to  (2l)  proves  the  theorem  in  Case  1. 


In  Case  2,  x^ 
X°,  X^^^  and  p-1 
X°  ,  X^  ,  X^, ...,X^ 


belongs  to  a  p-dimensional  simplex  generated  (by 
among  the  p  vectors  X^  ,  X^, . . . ,X^, ) say  by 
,  X^"*"^  .  Then, 


x^  =  X°  (X^  -  X°)  -  X°)  , 

£€L 

where  =  0 

>  0,  i  =  2  ,  5^  ♦  •  •  ^  P  ^  P+1 

i=l 

We  have  then,  by  the  same  computation  (somewhat  simpler)  as  in  Case  1 

cx^  -  cx°  =  /?-  t(c  -  u  a)  (X^"^^  -  X°) 
p+1'  o 

which  ends  the  proof  in  Case  2. 

In  practice,  the  computation  of  x^  needs  the  following  steps: 


Step  1,  compute  u^  ,  as  uniquely  given  by 

u^A(X'^  -  X°)  =  c(X'^  -  X°)  ,  Vi€L  . 
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step  2,  express  the  "adjusted  cost  row"  c  -  u^A  with  the  extreme  point 


X  ,  of  the  polyhedron  Q  ,  that  is  to  say,  compute  for  any  k  €  J  : 


-k  k  .k 
6  =  c  -u  A 

o 


j6J 


Ic  ““  o 

2.1,  if  6  >0,  keJ,  then  x  is  an  optimal  solution  (theorem  2); 

2.2,  let  s  6  J  he  such  that  6^  <  0  ;  consider  (as  defined  in 


\  P+1 

section  Ij,  and  compute  X  by 


=  X°  +  e  Y®  >  0 

s  — 

9  =  min  {  — ^  I  Y®  <  0  f 

s  j  e  J  -Y®  ^ 

(0  exists,  since  Q  is  bounded,  and  is  strictly  positive,  by  the 
s 

nondegeneracy  assumption). 

Step  5,  Compute  the  intersection  of  Ax  =  a  with  the  (p  i-l)-dimensional 

simplex  spanned  (by  means  of  convex  combinations)  by  X°,  X^,  X^,  ...,X^^^. 

This  intersection  is  a  segment  (of  which  x°  is  an  extremity),  any 
point  of  which  can  be  expressed  as 
P+1 


=  Z  ,  with 


=  0 


where 


i=0 

P+1 


^  =  0  and  ^  0  , 

p+l^° 

[Note  that  ^  (A^  +  p,^)  =  1  and  p,^  (unrestricted)]. 


i=0 
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Also  X  should  satisfy 

p+1 

A(x-x°)  =  0  |i^  =  0  . 

i=0 

We  have : 

P 

^  A(X^  -  X°)uL^  +  A(xP^^  -  =  0  . 

i=l 

We  have  easily  the  ^  ~  l,...,p+l  as  follows,  since 

xP+1  -  X°  =  Y®  0  : 

s 

first,  we  compute  i  =  1,2,  . . .  ,p  ,  as  \iniquely  determined  hy 

P 

^  (A(X^  -  X°)  +  AY®  =  0  ; 

i=l 

then,  we  have  the  jjl's  proportional  to  the  Vs  (with  Vl  " 

Let  y®  he  defined  hy 
P 

S  „S  \  v-ON  ,1° 

y  =  Y  +  2. 

l-=l 

Then  the  intersection  of  Ax  =  a  with  the  (p+1 ) -dimensional  simplex 
spanned  hy  X°  ,  X^, . .  -  ,X^'*’^  is: 


X 


o 


X 


+  Oy® 


where  0  is  hounded  hy 

^  0  »  V  i  e  L 


that  is  to  say,  the  maximum  value  of  0  is 


0 

o 


Min 

^eL 
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(we  must  notice  that  we  do  have  ^  some  i  ,  since 

P 


1  v“  .  0)  . 


In  case  1  as  well  as  in  case  2,  we  have 


1  o  ^  s 

X  =  X  +  Q^y 


4.1,  if  +  0  v'^  =  0  for  £  =■  0,  then  we  are  in  case  1:  perform  the 

’  £  o  £ 

change  of  has  is  in  the  suhprohlem,  from  X°  to  ; 

4.2  if  +  0  >  0  for  £  =  0,  then  no  change  of  basis  in  the  sub- 

problem  is  necessary. 

In  order  to  compute  u  (in  Step  l),  and  (Tv*^)  (in  Step  ^),  it  is 

°  ^  £eL 

necessary  to  know  a  ,  the  inverse  matrix  of  the  matrix  whose  columns  are 
(A(X'^  -  .  Assuming  that  we  know  a  ,  we  need  one  more  computation 


Step  5,  In  case  1,  assume  that  we  know  the  inverse  matrix  a  of  the  matrix 

0  Q 

whose  columns  are  A(  -  X  )  ,  X€L;  compute  the  inverse  a'  of  the 
matrix  whose  columns  are  A(X'^  -  X^"*”^)  ,  V  £^L.  Then,  we  write 


A(X^  -  X^'*'^)  =  A(X'^  -  X°)  +  A(X°  -  , 

=  A(X'^  -  X°)  -  e^AY®  . 


and  we  use  the  Morrison  formula  (with  a  row  vector  e  =  (l,l,l,...l)  that 
is,  =  1,  V  iSL) : 


a'  =  a  +  Ta  AY  e  a 


where 


1-0  ea  AY" 
s 


(t  exists,  since  we  already  know  that  a'  exists), 
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In  case  2,  ve  have  to  con5)ute  the  inverse  matrix  say  a'  of 
the  matrix  whose  columns  are 
-  X°)  , 

where  S,  =  2,5,.,.  ,p+l  . 

Here,  we  notice  that  the  columns  of  indices  2, 3,  ...,p 

remain  the  same,  while  the  column 

aCx^  -  X°) 

is  changed  to 

-  X°)  , 

which  can  he  written  as 

-  X°)  =  ACr*-  -  X°j  +  ACX^"^^  -  X^)  ; 

the  same  formula  as  above  applies,  but  e  must,  here  in  case  2, 
be  the  vector  whose  components  are  all  zeros,  except  one  (with 

,  B 

index  i;,  which  has  a  unit  value  (that  is:  e  =  0  if  i  e  L  but 
i  ^  1  ,  e  =  l).  The  Iteration  described  above  is  completely  equiva¬ 
lent  to  one  iteration  of  the  Decomposition  Principle  of  G.  B.  Dantzig 
and  P.  Wolfe,  when  starting  with  an  extreme  point  x°  of  M:  in 
the  latter  method,  we  have  to  solve  systems  whose  matrix  has,  as  its 
coliunns , 


where  S,  =  0,1,2,  ...,p  .  It  suffices  to  eliminate  one  unknown, 
chosen  in  the  obvious  manner,  to  have  the  matrix  considered  in  our 
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description.  We  have  already  seen  that  x  ,  thus  obtained  in  one 

iteration  of  the  subprdblem  in  the  Decomposition  Principle,  may  be 

a  non-extremal  point  of  M  ,  although  x°  was.  If  we  allow  more 

than  one  iteration  of  the  simplex  method  in  the  subproblem  in  the 

Decomposition  Principle,  then  the  same  result  applies.  The  reader 

will  easily  convince  himself  that,  in  the  latter  case,  x^  may 

even  lie  in  the  relative  interior  of  M  .  The  only  real  difference 

is  that  in  the  original  Decomposition  Principle  we  usually  perform 

the  change  of  basis  from  X°  to  ,  in  Case  1  as  well  as  in 

Case  2  (Contrary  to  Step  4,  Case  l).  The  distinction  between 

Case  1  and  Case  2  has  been  introduced  here  for  preparing  the  next 

sectionsj  also  the  introduction  of  the  matrix  whose  columns  are 

(A(X'^  -  X°))«  ,  instead  of  the  matrix  (  A  X”^  )  of  the 

£eL  V  ^ 

original  method,  has  chiefly  been  made  for  the  same  purpose. 

Finally  we  notice  that  the  5  Steps  Iteration  explained  above 

can  be  performed  on  a  point  x°  which  is  in  M  but  is  not  an 

o 

extreme  point  of  M  provided  that  this  x  is  a  convex  ccan- 
bination  of  p+1  extreme  points  of  Q  which  form  a  p-dimensional 
simplex. 

J.  Decomposition  Priuiciple  with  Extremal  Points  of  M 

In  some  numerical  experiments,  the  Decomposition  Principle 
has  led  to  some  lengthy  ccanputatlon  in  terms  of  the  number  of  iteia- 

ru] 

tions.  It  has  been  suggested  that  a  potential  reason  for  this 
is  that  the  current  point  x^  at  the  V  iteration  is  generally 
a  (relatively)  interior  point  of  the  polyhedron  Q  . 

In  this  section  again,  for  the  sake  of  brevity,  we  shall 
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assume  that  Q  (hence  M  also)  is  a  hounded  polyhedron,  and 
we  shall  give  some  ways  to  have  extreme  points  of  M  in  the 
successive  iterations. 

5.1  Let  again  x°  be  an  extreme  point  of  M  .  Once  a  ,  in 

Step  2  above,  has  been  obtained,  one  can  apply  the  Decomposi¬ 
tion  Principle  to  the  Restricted  Program  obtained  from 

Program  1  by  setting  x  =  0  ,  for  any  J  except  those  in 

J 

j(x°0  and  for  J  =  a  -  Solving  the  Restricted  Program  would 
be  the  analogous  for  the  Decomposition  Principle,  of  one  change 
of  basis  in  the  Sin5)lex  Method.  In  that  way,  we  have  a  method 
where  we  can  consider  that  there  are  outer  iterations  and  inner 
iterations : 

an  inner  iteration  consists  in  solving,  by  the  Decomposi¬ 
tion  Principle,  a  Restricted  Program  (m+1  unknowns  and  m 
equations ); 

an  outer  iteration  consists,  each  time  we  have  an 
extreme  point  x'*  of  M  ,  at  the  end  of  a  series  of 
inner  iterations,  in  choosing  an  adequate  new  Restricted 
Program  and  in  solving  it  by  the  Decomposition  Principle. 

The  result  of  one  outer  iteration  actually  is  one  iteration  of 
the  Simplex  Method,  as  applied  to  Program  1.  But  the  number  of  inner 
iterations  may  be  very  large.  As  an  illustrative  example,  let  us 
take  a  Program  which  is  solved  by  the  Simplex  Method  in  one  iteration. 
Let  us  assume  that  there  are  8  unknowns,  that  p  =  2  ,  q  =  5,  and 
that  the  five  equations  Bx  =  b  are  such  that  the  5-dimensional 
intersection  of  Bx  =  b  with  the  positive  orthant  x  ^  0  is  a 
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hexagonal  prism,  say  Q  ,  shown  in  Figure  3.  The  intersection 
with  Q  ,  of  the  linear  variety  Ax  =  a  (2  equations)  is  a 
segment,  say  M  .  Starting  with  an  extremity,  say  x°  ,  we 
shall  reach  the  other  extremity,  say  x  ,  hy  one  outer  iteration; 
however,  this  might  mean  6  inner  iterations,  which  are  listed 
below  (at  each  iteration,  the  polyhedron  Q  is  expressed  with 
the  first  of  three  edges  listed) ; 


Start 

x" 

x" 

1st 

iteration 

x5 

x^x" 

2nd 

iteration 

x^ 

x^ 

x" 

3rd 

iteration 

x^ 

x5 

4th 

iteration 

x5 

x^ 

x5 

5  th 

iteration 

x^ 

x^ 

x^ 

6  th 

iteration 

x^ 

x" 

x5 

END. 


FIG.  3 
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3.2  Let  us  return  to  Step  3  of  the  Algorithm  (Section  2).  Once  y®  has 


been  computed,  the  set  of  x's  such  that 
(l)  X  =  x°  +  0y^ 


is,  for  0  ®  ^  ®  edge  of  M  ;  the  maximijm  value  of  0  is 

easily  computed  as : 


(2) 


0  =  min 
JeJ(x°) 


the  point 

(3)  X  =  x°  +  0  y® 

the  second  extremity  (other  than  x°)  of  M  on  the  considered  edge. 
Now,  the  corresponding  p-dimensional  face,  say  F^(x),  of  Q  (uniquely 
determined,  since  no  degeneracy  is  allowed,  by  the  property  that  x  lies 
in  its  relative  interior)  has,  as  its  p-dimensional  variety  support, 
the  smallest  dimensional  variety  which  contains  F^(x)  ,  that  whose 
equations  are 

(4) 

(5)  x^,  =  0  and  x-,  =  0 
where 


(6)  K'  =  J(x)  =  {J  :  X  >  0}  . 

J 

It  only  remains  to  find  p  +1  vertices  of  F^(x)  such  that  x  belongs 
to  their  convex  h\ill;  this  usually  requires,  if  p  is  not  a  very 
small  number,  a  lot  of  simplex-like  Iterations  on  the  sub -subproblem 
(4)  (merely  to  find  in  that  manner  a  first  edge  of  F^(x)  needs  p 
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iterations). 

Then,  lonless  p  is  very  small,  or  unless  the  suh-subprohlem  (4) 
is  so  special  that  it  is  a  simple  matter  to  express  x  as  a  convex 
combination  of  vertices  of  F^(x)  ,  this  second  vay  to  handle  the 
Decomposition  Principle  in  order  to  have  extreme  points  of  the  original 
program  seems  unsatisfactory. 

Another  unpleasant  feature  is  that,  though  ve  have  assxmed  that 
we  know  the  inverse  matrix  a  ,  this  is  of  quite  no  use,  since  the 
cni  limns  A(X'^  -  X° )  may  all  have  changed  on  passing  from  x°  to  x  . 


We  now  state  the  following  resvilt  (which  we  shall  use  later  on)  as  a 


simple  consequence  of  Theorem  2,  and  of  the  definition  of  Y  and  x  : 


THEOREM  3 

—  o 
C  X  <  cx 

if  and  only  if 

(c  -  u  A)  Y®  <  0 

5.5  One  can  overcome,  in  part,  the  difficulties  encountered  in  section 
5.2  in  the  following  way:  once  Q  has  been  expressed  with  an  extreme 
point,  say  X°  ,  of  F^(x°)  ,  one  will  express  x°  as  the  sum  of  X° 
and  a  positive  linear  combination  of  some  extreme  half-lines  of  C(X°)  . 
More  precisely,  x°  will  be  expressed  as 

(1)  x°  =  X°  Y-^Xj  , 

jei 


where  the  scalars  are  strictly  positive  by  the  nondegeneracy  hypothesis 

J 

(the  notations  have  been  explained  at  the  end  of  section  1  and  beginning  of 
section  2).  Now,  everything  in  Section  2  can  be  rephrased  so  as  to  cover 
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the  algorithm  thus  obtained. 

We  shall  call  C^(X°;  x°)  the  p-dimensional  finite  cone 

(2)  X  =  X°  Y'^V  , 

jei 

where  the  scalars  X.  are  arbitrary  and  such  that 

J 

(5)  Xj  >  0  ,  V  j  €  I 

This  cone  has  X°  as  its  origin,  and  (once this  has  been  assumed)  is 

characterized  (due  to  nondegeneracy)  by  the  following  property:  it  is 
the  p-dimensional  face  of  C(X°)  which  contains  x°  ;  or  equivalently 
by  the  following  one:  it  is  the  smallest  (in  terms  of  inclusion)  face 
of  C(X°)  containing  x°;  or  equivalently  by  another  one:  it  plays 
for  the  polyhedron  F^(x°)  the  same  role  as  C(X°)  for  the  polyhedron 

Q  .  Moreover,  the  's  here  play  the  role  of  the  (X  -  X  )  's  in 

Section  2.  Let  us  restate  Lemmas  1  and  2  and  Theorem  1: 


T/:.TnTna  j,  -  The  Set  of  vectors  an  independent  set. 

Lemma  1+  -  The  matrix  whose  colums  are  (AY"^ )  .  _  is  a  square  nonsingular 


'jei 


matrix. 


We  shall  call  Y^ 
the  inverse  matrix  of 


the  matrix  whose  columns  are  f 

AY^  ,  the  square  nonsingular  mati’ix  of  Lemma  4. 


THEOREM  4 

The  hyperplane  containing  C^(X°;x°)  and  parallel  to  Ax  =  0  and  cx  =  0 
has  an  equation: 

(c  -  u^A)  X  =  (c  -  u^A)  X° 

where  u  is  the  unique  solution  of 
o 
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0 


(c  -  uA)  - 

that  is,  is  explicitly  given  by: 

u  =  cY^A,.  . 
o  1 

It  is  a  simple  matter  to  see  that  in  theorems  1,  2,  5,  and  in 

theorem  4  is  the  same. 

Let  s  be  any  index  not  in  K;  then  the  half-line 
X  =  X°  +  Y^O 

(where  0  is  a  nonnegative  arbitrary  scalar)  is  an  extreme  half -line  of 
C(X°)  which  does  not  belong  to  C^(X°;  x°)  ;  conversely,  we  have  any  of 
these  extreme  half-lines  in  allowing  s  to  take  any  value  in  K  ,  We 
consider  C^‘‘’^(X°;x°,Y® )  ,  the  (p+1 ) -dimensional  face  of  C^(X°)  generated 

X  Of  Sections  5.1  and  5.2  precisely  is  the  extremity  (other  than  x  ) 
of  the  segment  [x°,  x]  ,  intersection  of  this  ( p+1 ) -dimensional  cone 
cP+l(xO.  Y®)  with  the  (n-p)-dimensional  polyhedron,  say  P  : 

P  =  {x  :  Ax  =  a,  x  ^  0}  . 

We  notice  that  theorem  5  above  applies  here,  since  every  symbol  has 
the  same  meaning. 

Once  we  have  x  ,  we  now  have  just  to  find  one  extreme  point  of 
F^(x)  ,  which  needs  some  simplex  like  computations  in  the  sub  subproblem. 

B^'x  ,  =13,  liut  nothing  more;  this  finally  is  less  work  than  for  the 
method  of  section  5.2,  since  we  do  not  need  here  the  other  p  extreme 
points  that  were  necessary. 

But  this  new  method  is  as  unsatisfactory  as  the  preceding  one  when 
we  come  to  the  computation  of  the  new  A^.  ;  "the  new  matrix  Y  may  be 
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a  matrix  completely  different  from  the  old  one,  and  we  may  have  to 
completely  invert  the  new  matrix  AY  ^  this  will  need  p  iterations 
of  the  method  used  in  Section  2,  Step  case  2  . 

Although  the  algorithm  thus  obtained  for  passing  from  x°  to  x  , 
needs  less  work  than  the  preceding  one,  yet  it  is  approximately  p  times 
more  lengthy  than  another  one  to  be  described  in  Section  4. 

3,4  There  exists  another  procedure  for  finding  a  first  vertex  of  F^(x): 
it  simply  consists  in  solving  the  following  program,  with  X  as  a 
starting  point: 


Minimize  x 

r 

subject  to 

■fix  =  b 
X  ^  0, 


where  r  is  the  index  j  in  formula  (2)  of  section  3.2  such  that 


0  = 


y®  <  0 
r 


9 


that  is  the  index  reJ(x°)  such  that  x^  =  0  . 

This  may  lead  to  a  fewer  number  of  simplex  computations  in  the  sub- 
problem  Bx  =  b,  but  do  not  overcome  the  other  difficulties. 


4  .  An  Algorithm  for  Decomposition 

We  shall  now  turn  our  attention  to  the  method  outlined  in  Section  3-3> 
but  will  not  restrict  ourselves  to  feasible  extreme  points  of  Q  .  More  precisely 
we  shall  say  that  a  point  X°  ,  belonging  to  the  linear  variety  Bx  =  b  ,  is  a 
Q-primordial  point  if  the  following  property  holds: 

Letting, 
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(1) 


J  =  J(x‘")  =  {J  :  x"  ^  0) 

fj 

the  set  of  vectors  ^ j  ej(x‘^)  independent  set.  We  shall  say 

that  is  a  nondegenerate  primordial  point  for  Q  if  J(X°)  has 

exactly  q  elements.  We  shall  assume  throughout  the  sequel,  that  there 
is  no  degeneracy  of  any  kind,  including  that  described  Just  now.  But 
contrary  to  the  simplifying  assumption  made  in  section  1  to  3,  we  do 
not  assume  any  boundedness  of  the  various  polyhedra  we  will  c  nsider. 

For  any  Q-primordial  point  X°  ,  one  can  repeat  the  considerations 
of  Section  1,  except  for  the  slight  change  in  the  definition  of  J(x''^) 
which  has  been  given  above.  We  define  C(X°)  as  the  smallest  cone 
(in  terms  of  inclusion)  with  apex  X°  ,  and  containing  Q  .  Figure  i*-, 
as  an  example,  assumes  that  Q  is  a  2-dimensional  pentagon,  a  Q- 
primordial  X°  is  represented,  together  with  two  generators  of  C(X°) 
(this  latter  cone  is  an  angle  with  apex  X°)  .  Finally,  the  relations 
which  define  C(X*^)  are  the  same  as  in  Section  1,  that  is 
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(2)  By  =  0 

(3)  >  0  Yt  (unrestricted) 

The  characterization  we  gave  in  Section  1  for  C(X°) 
extreme  half  lines  of  this  cone,  still  holds  exactly, 
explicit  formula  given  at  the  end  of  Section  1. 

As  in  Section  2,  let  x°  be  an  extreme  point  of 


K  =  J(x°)  =  (J  :  x°  >  0) 

J 

I  =  J(x°)  -  J(X°)  =  K  -  J  . 


Then  the  unique  p- dimensional  face,  say  C^(X°;  x°) 
taining  x°  is  the  set  of  all  the  x's  such  that: 

{“)  ='  ■  ’f"  ’'J  ' 

jel 

(5)  ^  0  ,  V  J  e  I 


(6) 


In  particular,  we  have 
-vJ  1.*^ 

Jei 


X  =  X  Y  , 


for  some  set  of  scalars 


satisfying 


( nondegeni 


(7) 


A .  >  0  ,  V  .  _ 

J  JGI 


The  extreme  half -lines  of  C(X°)  which  are  not  in 


(8) 


X  =  X°  +  0Y®  , 


where  the  scalar  0  is  ^  0  ,  and  s  e  K  . 


as  well  as  for  the 
as  well  as  the 

M  ,  and  define 


of  C(X°)  ,  con- 


xacy)  ; 


(X  ;  X  )  are 
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T/»TtitnB.  3  and  4  and  Theorem  4  of  the  preceding  section  still  hold  exactly. 

We  shall  give  an  interpretation  of  .  Let  us  consider  the  dual 
inequalities  to  Program  1  : 

uA  +  vB  ^  c 

where  u  ,  v  respectively  are  p-dimensional  and  q-dimensional  row 

vectors.  Let  u'  ,  v  he  the  dual  prices  associated  with  the  basic 
o  o 

solution  x°  : 

(u'  ,  V  )  is  the  unique  (u,  v)  such  that 
o  o 

u'  +  V  =  c^  ,  Vke  K  . 

o  o 

We  notice  now  that  if  ke  ic  and  j  e  I,  then  =  0  (see  the  definitions 
of  K,  I,  Y"^).  From  the  preceding  inequalities  we  have  then 

u '  AY-^  +  V  BY-^  =  cY*^  ,  V  J  6  I  . 
o  o 

But  BY"^  =  0  >  J  €  I  ( see  definition  of  Y"^ )  . 

We  conclude 

u'  AY^  =  cY^  ,  u'  =  cY^A, 

o  '  o  I 

which  (hy  theorem  4)  shows  that  ~  ‘ 

Thus  the  p-dimensional  row-vector  u^  in  theorem  4  is  the  dual  price-vector 
associated  with  the  set  of  equations  Ax  =  a  and  with  the  basic  solution 
x°  of  Program  1. 

As  the  same  kind  of  proof  applies  to  the  row-vector  u^  of  Sections  2 

and  we  see  that  the  u  's  in  all  consideration  of  this  paper  are  the 

o 

same. 
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THEOREM  5 


The  (p+l) -dimensional  cone  x°,  Y^)  defined  by 

(9)  X  =  X°  Y'^T.j  +  Y®  0  , 

Jei 

(10)  ^  0  ^  J  » 

(11)  e  ^  o 

intersects  the  p-dimensional  polyhedron  P(Ax  =  a,x^0)  on  a  half -line 

o 

or  a  segment,  one  extremity  of  which  is  x  . 

We  shall  first  compute  the  intersection  of  the  smallest  linear 
variety  containing  cP'^^(X°j  x°,  Y® )  with  the  linear  vzriety  Ax  =  a; 
this  intersection  is  the  line  defined  by 

(12)  X  =  X°  +  Y^  +  Y®  0 

(15)  Ax  =  a  , 

where  is  the  p-dimensional  vector  whose  components  are 

A  substitution  gives  , 

AY^X^  =  a  -  AX°  -  AY®Q  , 

hence,  by  multiplying  on  the  left  by  ,  the  Inverse  matrix  of  AY  : 

(14)  =  Aj  (a  -  AX°)  -  Aj  (ay®)  0  . 

The  intersection  is  then  the  line 

X  =  x°  +  (Y®  -  Y^  Aj  ay®)  0  , 

that  is 

(15)  X  =  x°  +  y  0  , 
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setting 


(16)  y  =  Y®  -  Y^  Aj  ay®  . 

To  in^ose  xeM  and  since  x°e  M  it  follows  that  Ay  =  0  and 

(17)  x°+ye^O,  0^0. 

If  y  ^  0  ,  then  the  half -line  (15)  is  contained  in  M  j  if  not,  then 
there  is  a  maximum  value  of  G  in  (17 ),  say  0  ,  The  point 

X  =  X  +  y  y 

is  then  the  vertex  of  M  ,  other  than  x°  ,  on  the  edge  of  M  defined 
by  the  conditions 

(18)  Ax  =  a 

(19)  Bx  =  b 

(20)  X,  ^  0  ,  V  J  'S  K+s 

J 

(21)  °  J  cK+i" 

In  any  case  the  following  theorems  will  be  useful: 

THEOREM  6 

cy  <  0 

if  and  only  if 

(c  -  u^A)  Y®  <  0  , 

PROOF ; 

cy  =  (c  -  cY^Aj.A)  Y®  ,  by  (l6) 

=  (c  -  u^A)  Y®  ,  by  theorem  4. 
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THEOREM  7 


X  is  an  optimal  solution  to  Program  1  if  and  only  if 


(c  -  u^A)  ^  0  ,  V  JeK 


PROOF : 


o  o 

X  is  optimal  if  and  only  if  for  any  edge  of  M  out  of  x 


x  =  x  +Qy, 


we  have: 


cy  ^  0 

It  only  remains  to  notice  that  any  edge  of  M  ,  out  of  x°  is  uniquely 
associated  with  a  hy  (l6),  as  it  has  been  shown  in  (l8)  to  (2l). 

We  shall  now  give  the  outline  of  the  Algorithm.  Starting  with  x°  ^  X°  ,  Aj  , 
and  the  expression  of  Q  with  X°  (which  automatically  gives  any  Y"^  ,  j  £  J  , 
we  want)  we  successively  confute: 

1,  .  cy"  Aj 

2.1,  If  (c  -  u^A)Y'^  then  x°  is  an  optimal  solution  of 

Program  Ij 

2.2,  if  not,  let  b€K  be  such  that 

(c  -  Y^<  0  ; 

5,  compute 

y  =  Y®  -  Y^Aj.  ay® 
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3-1,  if  y  >  0  ,  then  the  minimum  of  cx  in  Program  1  is  -  oo  ; 

3,2,  if  not,  compute 

o  ,  o 

Q  =  =  min  ■]  —  I  y .  <  0 

4,  We  already  have  x  (the  new  x°  from  17)-  We  must  compute  a 
new  X°  ,  a  new  ,  a  new  expression  for  Q  in  terms  of  the 

new  X°  .  The  following  section  is  devoted  to  this  Step  4  (last 
step  of  the  finitely  iterative  algorithm). 


Discussion  and  Formulas  for  the  Last  Step  of  the  Iteration 
We  shall  use  the  formulas 


(2)  > .  ^  0  ,  V  j  e  I 

0  >  0 

We  distinguish  three  (nondegenerate,  exhaustive)  cases  respectively 
illustrated  in  Figs.  5,  6,  7- 

Case  1,.  X°  helongs  to  the  hj^erplane  x^  =  0  . 
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Then  x  is  a  point  of  the  cone  C^‘''^(X°;  x°,  Y®)  which  at  the  same 

time  is  on  the  boundary  of  this  cone.  This  means  that  x  belongs  to 

one  of  its  p- dimensional  face,  namely  the  face  obtained  by  setting 

X  =  0  .  This  shows  that  r  €  I  and  7\  =  0  . 
r  r 

Conversely,  if  r€I  and  =  0,  then  (l)  gives  x^  =  0. 

In  that  case,  we  set  X  (the  new  X°) 

X  =  X°: 

i.e.,  we  do  not  make  any  change  of  basis  in  the  subproblem  Bx  =  b 
(Q  remains  expressed  with  X°)  ; 

I  becomes  I  -  r  +  s  ; 

J  remains  as  it  stands. 


The  computation  of  the  new  A^.,  say  A  ,  easy,  using  the  Sherman' 

1*  I 

Morrison  formula.  In  fact,  the  column  AY  of  the  matrix  AY  (of 

s 

which  Aj.  is  the  inverse)  is  changed  into  AY  ,  and  that  is  all  the 
change  to  be  made: 

(3)  A  =  A^  +  lA^A^Y^  -  Y®)  A^  , 

where 


i-a/(y^-y®)  a/y" 


and  A  is  the  rth  row  of  A^  . 
r  —  I 

Notice  that  in  (3)  A^  AY^  is  simply  the  rth  unit  vector. 
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contained  in  the  hyperplane  =  O). 

In  the  present  case,  we  take  X  (the  new  X° )  as  the  intersection, 
r  does  not  belong  to  I  (otherwise,  we  should  be  in  case  l),  then 
r  €  J  .  Then 


I  stands  at  it  is; 

J  becomes  J  -  r+s  (one  change  of  basis  in  the  subproblem, 

WT  th  as  a  pivotal  element ) . 

r 

We  again  have  to  compute  the  new  Aj  >  say  A  .  First,  the  expression 
of  has  changed,  from  to 


(5) 


y" 


(e^ 


Yb 

r 


T  I  r 

(where  Y  is  the  rth  row  of  the  matrix  Y  ,  and  e  is  the  rth 

unit  column-vector ) . 

Then  AY^  has  changed  to 

(6)  AY^  +  ^  (a""  ay®)  Y^  , 

Y® 

r 


Application  of  the  Sherman-Morrison  formula  gives: 
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(7) 


A  =  Aj  -tA^(A^  -  AY^)Y^Aj  , 


(this  is  not  a  case  of  degeneracy,  since  it  cannot  be  avoided  by  an 
S -perturbation  of  the  cost  function  or  the  right-hand  side).  There 
must  be  an  extreme  half -line  of  C^(X  ;  x  )  which  intersects  the 
hyperplane  x^  =  O  (if  not  (X  j  x  ,  Y  )  should  be  parallel  to 

this  hyperplane;  but  this  is  not  the  case,  since  x  lies  in  the  inter- 
section).  This  shows  that  there  exists  some  7^  0  ,  with  tel. 

Once  t  is  thus  chosen  in  I  ,  we  make  a  succession  of  two  substeps: 

Sub step  1.  Apply  case  2  for  changing  J  into  J  -  R  +  t; 

Sub step  2.  Apply  case  1  for  changing  I  into  I  -  t  +  s. 

6.  An  Alternative  Approach  to  the  Same  Algorithm 

We  shall  not  give  a  general  idea  by  which  one  can  find,  in  addition 

to  the  algorithm  above,  the  algorithm  of  G.  B  Dantzig,  A.  S.  Manne,  W.  Orchard- 

Hays,  and  J.  T.  Robacher,  as  well  as  some  others. 

We  apply  the  simplex  method  to  Program  1.  Let  x°  be  a  basic 
feasible  (nondegenerate)  solution;  let  K  be  the  set. 
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whose  oolvunns 


K  =  (J  :  x°  >  0) 
J 


Let  J  be  a  subset  of  K  such  that  the  matrix,  say  B  , 
are  )  .  is  a  square  nonsingular  matrix,  and  let  I  be  K  -  J 

complement  of  J  with  respect  to  K  .  We  call 


the  matrix  whose  columns  are  )  j  €  I 

the  matrix  whose  columns  are  (B"^ )  j  e  I 

A*^  the  matrix  whose  columns  are  )  j  e  J 


We  shall  take,  as  an  example,  the  "full  inverse"  method.  The 
of  the  basic  matrix  is 


where 

(2)  Pj=(E'^)'^ 

(3)  Aj  =  (A^  -  A'^PjB^)  . 

First  we  notice  that,  with  the  notations  of  Section  5 : 

=  I  X  I  identity  matrix 

y|-o, 

SO  that 


,  the 


inverse 
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AY^  =  -  A'^p^  ; 

J 


then  the  under  consideration  here  is  the  same  as  in  Section  4  and 

5. 

Second,  in  the  simplex  method  ve  have  to  compute 


(5) 


=  c*^  -  u  A*^  -  V 
o  o 


for  every  j  €  K  ,  where  u^  ,  v^  are  given,  using  (l)  and  setting 

c  =  <■=  )l€I 

J  /  Jn 

^  )j€J  ^ 

(6)  u^  =  c\  -  b\ 

(7)  =  c-'p.  +  c^Pj  b\  aSj  -  A^Pj  . 


Formula  (6)  is  exactly 

(8)  u^  =  cY^A^  , 

which  is  the  method  used  in  Section  4  for  computing  u^  ,  and  formula 
(7)  may  he  written 

(9)  , 

whence 

(10)  S®  =  c®  -  u^  A®  -  (c'^Pj  -  cY^A^A-^Pj)  B®  , 

S®  =  c®  -  -  cY^A^(A®  -  A'^PjB®)  , 
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and  finally 
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Finally,  the  algorithm  of  Sections  4  and  5  is  nothing  else  than  the 
adaptation  of  the  Simplex  Method  if  we  assinned  that  we  keep,  in  the 
memory  of  the  computer: 

c  ,  A  ,  x°  ,  Aj  ,  PjB  , 

so  that  at  the  end  of  the  iteration,  we  have  to  compute: 

the  new  x°  (which  is  easy) 
the  new  , 

the  new  (change  of  basts  in  the  subprdblem)  . 

As  a  slight  modification,  one  can  keep  in  the  memory: 
c  ,  A  ,  B  ,  x°  ,  Aj  ,  Pj  • 

The  method  thus  obtained  only  differs  from  our  algorithm  in  that 
now  we  use  the  full  inverse  for  the  subproblem,  whereas  in  our  algorithm 
we  use  the  Simplex  Tableau;  the  algorithm  of  Sections  4  and  5  is  then  a 
very  slight  modification  of  the  algorithm  of  G.  B.  Dantzig,  A,  S.  Manne, 
W.  Orchard-Hays,  and  J.  T.  Robacker. 

It  is  clear  that,  in  varying  the  quantities  kept  in  the  memory,  one 
can  have,  following  the  same  line  of  approach,  many  other  modifications 
of  the  simplex  method  which  take  into  account  the  horizontal  splitting  of 
the  matrix  of  Program  1. 
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APPENDIX  1 


The  Sherman-Morrisor)  *s  Formula  [5]. 

Let  A  be  an  n  x  n  regular  matrix,  and  consider  the  following 
modification  of  A  : 

A  - >  A  +  BC 

where  B  is  an  n  x  m  and  C  an  m  x  n  matrix  (as  a  particular  case, 
which  actually  is  the  only  one  we  needed  in  the  paper,  B  is  an 
n-dimensional  column-vector  and  C  is  an  n-dimensional  row-vector). 
There  is,  accordingly,  a  modification  of  the  inverse  of  A  : 

a"^ - >  a"^  -  a“^  BM"^  CA“^  , 

where,  denoting  by  I  the  m  x  m  identity  matrix, 

M  =  I  +  CA"^  B 

(in  the  previous  particular  case  M  is  a  scalar). 

PROOF:  it  suffices  to  check  by  direct  canputation  that 
(a"^  -  a‘^  bm“^  ca‘^)  (a  +  BC) 


is  equal  to  the  n  x  n  identity  matrix. 


APPENDIX  2 


On  Notations 

We  have  adopted  the  following  systematic  notations  for  suhmatrices 
of  a  given  matrix  [2]  : 

Let  A  be  a  matrix,  G  be  a  subset  of  the  set  of  rows  indices  of 
A  ,  and  H  be  a  subset  of  the  set  of  columns  indices  of  A. 

We  denote  by  A^  the  ith  row  of  A  ,  by  A'^  the  column 

of  A  ,  by  a9  the  element  at  the  intersection  of  the  i;to  row  and  jth 

!  ^ 

colxjmn  of  A  .  Moreover: 

A  is  the  submatrix  of  A  whose  rows  are  (A.  )  , 

^  i€G 

A^  is  the  submatrix  of  A  whose  colvunns  are  > 

A^  is  the  submatrix  of  A  whose  elements  are  (A^  ) 

G  (i,j)  e  GxH 

In  particular,  this  applies  to  vectors,  so  that  if  x  is  a  column- 
vector  and  G  a  subset  of  its  components  indices,  then  x^^  is  the  sub- 
f  column  vector  whose  components  are  j  likewise, 

vector  and  H  a  subset  of  its  components  indices,  then 
I  row  vector  whose  con5)onents  are  " 
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if  u  is  a  row- 
H 

u  is  the  sub- 
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